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Abstract — We develop a general approach for designing 
scheduling policies for real-time traffic over wireless chan- 
nels. We extend prior work, which characterizes a real-time 
flow by its traffic pattern, delay bound, timely-throughput 
requirement, and channel reliability, to allow time-varying 
channels, allow clients to have different deadlines, and allow 
for the optional emplojonent of rate adaptation. Thus, our 
model allow the treatment of more realistic fading channels 
as well as scenarios with mobile nodes, and the usage of 
more general transmission strategies. 

We derive a sufficient condition for a scheduling policy 
to be feasibility optimal, and thereby establish a class of 
feasibility optimal policies. We demonstrate the utility of the 
identified class by deriving a feasibility optimal policy for the 
scenario with rate adaptation, time-varjdng channels, and 
heterogeneous delay bounds. When rate adaptation is not 
available, we also derive a feasibility optimal policy for time- 
varjdng channels. For the scenario where rate adaptation is 
not available but clients have different delay bounds, we 
describe a heuristic. Simulation results are also presented 
which indicate the usefulness of the scheduling policies for 
more realistic and complex scenarios. 

I. Introduction 

With the wide deployment of Wireless Local Area Net- 
works (WLANs) and advances in multimedia technology, 
wireless networks are increasingly being used to carry 
real-time traffic, such as VoIP and video streaming. These 
applications usually specify throughput requirement while 
meeting specified delay bounds. We study the problem of 
designing scheduling policies for such applications. 

While there has been much research on scheduling real- 
time traffic over wireline networks, the results are not di- 
rectly applicable to wireless networks where channels are 
unreliable, with qualities that may be time-varying either 
due to fading or node mobility. Also, individual clients 
may impose differing delay requirements. These features 
present new challenges to the scheduling problems. 

We consider the scenario where an Access Point (AP) 
is required to serve real-time traffic for a set of clients. A 
previous work [10] solves the scheduling problem in a re- 
strictive environment and proposes two feasibility optimal 
policies. In particular, it assumes a fixed transmission rate, 
a static channel model, and that all clients in the system 
require the same delay bound. We extend this model so 
that it can capture the traffic patterns, delay bounds, 
timely-throughput bounds, and delivery ratio bounds of 
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views of the above agencies. 



clients, for time-varying wireless channels. We address 
scenarios with and without rate adaptation. We establish a 
sufficient condition for a scheduling policy to be feasibility 
optimal. Based on this we describe a class of policies and 
prove that they are all feasibility optimal. 

To demonstrate the utility of the class of policies, 
we study three particular scenarios of interest. The first 
scenario employs rate adaptation and treats time-varying 
channels, as well as allowing different delay bounds for 
different clients. The other two scenarios treat the case 
where rate adaptation is not available. One scenario con- 
siders time-varying channels, while the other considers 
the scenario where clients require different delay bounds. 
For the former two scenarios, we derive computationally 
tractable scheduling policies and prove that they are 
feasibility optimal. We also obtain a heuristic for the third 
scenario. 

We have also tested the derived policies using the 
IEEE 802.11 standard in a simulation environment. The 
results suggest that the three policies outperform others, 
including the policies in [10], and a server-centric policy 
that schedules packets randomly. In particular, since the 
policies introduced in the previous work fail to provide 
satisfactory performance in the environments studied 
here, this suggests that neglecting the facts that the sys- 
tem can apply rate adaptation, that wireless channels are 
time-varying, and the possibility that clients may require 
different delay bounds, can result in malperformance of 
the derived policies. 

Section II reviews some of the related work. Section 

III describes the extension of the model in [10]. Section 

IV discusses some useful observations for scheduling and 
reviews policies proposed in [10]. In Section V, we study 
an extension for time-varying channels. In Section VI, 
we derive a general class of policies that are feasibility 
optimal. Based on this class, we obtain scheduling policies 
in Sections VII and VIII, and a heuristic in Section IX, for 
different scenarios. In Section X, we discuss implementa- 
tion issues and simulation results. Section XI concludes 
the paper. 

II. Related Work 

The problem of providing QoS over unreliable wireless 
channels has received growing interest in recent years. 
Tassiulas and Ephremides [18] have considered the prob- 
lem in a single-hop network by assuming ON/OFF chan- 
nels and derived a throughput-optimal policy. Though the 
policy is unaware of packet delay, Neely [15] has shown 
that average packet delay is constant regardless of the net- 
work size. Andrews et al [1] have proposed another policy 
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that aims to improve packet delay. They have proved 
that their pohcy is also throughput optimal but offer no 
theoretical bound on packet delays. Liu, Wang, and Gi- 
annakis [14] have used a cross-layer approach to provide 
differentiated service for a variety of classes of clients. 
Grilo, Macedo, and Nunes [8] have proposed a resource- 
allocation algorithm based on the expected transmission 
time of each packet. Since the expected transmission 
time may not be an accurate indication of the actual 
transmission time, their work cannot provide provable 
delay guarantees. Raghunathan et al [16] and Shakkottai 
and Srikant [17] have both approached this problem by 
analytically demonstrating algorithms to minimize the 
total number of expired packets in the system. Their 
results, hov\?ever, cannot provide differentiated service to 
different clients. Hou, Borkar, and Kumar [9] have studied 
the problem of providing QoS based on delay bounds and 
delivery ratio requirements, and proposed two optimal 
policies under some restrictive assumptions. Their work 
has been further extended to deal with variable-bit-rate 
traffic [10]. In this paper, we extend this work to more 
realistic scenarios, including rate adaptation, time-varying 
channels and heterogeneous delay bounds among clients. 
Fattah and Leung [6] and Cao and Li [3] have surveyed 
other existing scheduling policies for providing QoS. 

III. System Model 

We begin by extending the model proposed in [10], 
which only considers a static channel condition and fixed 
delay bounds for all clients, to account for network be- 
havior and application requirements for providing QoS in 
wireless systems. 

Consider a wireless system with N clients, 
{1,2, ...,A^}, and one access point (AP). Packets 
for clients arrive at the AP. Time is slotted with slots 
t e {0,1,2,...}. Time slots are further grouped into 
periods [kT, {k + 1)T) with period length T. Packets 
arrive at the AP at the beginning of each period, at time 
slots {0, T, 2T, . . . }, probabilistically, with no more than 
one packet per client. We model the packet arrivals as a 
stationary, irreducible Markov process with finite state. 
The average probability that packets arrive for subset 
S of clients is R{S). Packet arrivals can be dependent 
between clients, and packet arrivals in a period can 
depend on other periods. 

Each client n specifies a delay requirement r„, with 
Tn < T. If the packet for client n is not delivered by the 
Tn'^ time slot of the period, the packet expires and is 
discarded. This scheme applies naturally to a wide range 
of server-centric wireless communication technologies, 
such as IEEE 802.11 Point Coordination Function (PCF), 
WiMax, and Bluetooth. 

We consider an unreliable, heterogeneous, and time- 
varying channel model. We model the channel condition 
as a stationary, irreducible Markov process with a finite set 
of channel states C. The average probability that channel 
state c occurs is fc and the channel state remains constant 
within each period. We consider the system both with 
rate adaptation and without. When rate adaptation is not 
available, that is, when all packets are transmitted at a 
fixed rate, the AP can make exactly one transmission in 
each time slot. Under channel state c, the link reliability 
between the AP and client n is pc.n, so that a packet 
transmitted by the AP for client n is delivered with 
probability pc^„. On the other hand, when the system uses 



rate adaptation, the channel states describe the maximal 
rates that can be supported between the AP and clients, 
which in turn decide the service times for transmissions. 
Under channel state c, it takes Sc,n time slots to make an 
error free transmission to client n. 

The channel state and the packet arrivals in a period 
are assumed to be independent of each other. We also 
assume that the AP has knowledge of channel state, as 
well as whether a transmission is successful, for example, 
through ACKs, in which case pc,n is the probability tfiat 
the AP receives an ACK after making a transmission. 

Each client n requires a timely-throughput of at least 
q-n packets per period. Since, on average, there are 
£s ries R{S) packets for client n per period, this timely- 
throughput bound can also be interpreted as a delivery 
ratio requirement of — . 

Definition 1: A set of clients, {l,2,...,iV} is fulfilled 
under a scheduling policy r], if for every e > 0, 

Prob{ ^"'j'^ > Qn- e, for every n} — > 1, as t ^ oo, 

where dn{t) is the number of packets delivered to client 
n up to time t. 

IV. Scheduling Policies 

Since the overall system can be viewed as a controlled 
Markov chain, we have: 

Lemma 1: For any set of clients that can be fulfilled, 
there exists a stationary randomized policy that fulfills the 
clients, which uses a probability distribution based only 
on the channel state, the set of undelivered packets, and 
the number of time slots remaining in the system (and 
not any events depending on past periods), according 
to which it randomly chooses an undelivered packet to 
transmit, or stays idle. 

Since the computational overhead for some complex 
policies may be too high for real-time applications, we 
consider the limited set of priority-based policies, which 
require computation only at the beginning of each period: 

Definition 2: A priority-based policy is a scheduling pol- 
icy which assigns priorities to some of the clients, based 
on past history and current state of the system, at the 
beginning of each period. During the period, a packet for 
a client is transmitted only after all packets for clients with 
higher priorities have been delivered. Packets for clients 
which do not receive a priority are never transmitted. A 
stationary randomized priority-based policy is one which 
chooses the priority order randomly according to a prob- 
ability distribution that depends only on the channel state 
and packet arrivals at the beginning of each period. We 
denote by P and Vrami the sets of priority-based policies 
and stationary randomized priority-based policies. 

Definition 3: A set of clients is feasible in the set P (or 
Prand) if there exists some scheduling policy in P (or 

Prand) that fulfills it. 

Similar to Lemma 1, if [(/„] is feasible in the set P, it is 

also feasible in the set Fraud- 
Definition 4: We call the region in the iV-space formed 

by vectors [g„] for which the clients are feasible in P (or 

all policies), as the feasible region under P (or all policies). 
Lemma 2: The feasible region under the class of all 

policies, or P, are both convex sets. 

Proof: Let and [q'^] be two vectors in the feasible 

region under P, and thus also feasible in Prand- Let rj 
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and 77' be policies in Prand that fulfill the two vectors, 
respectively. Then, the policy in P that randomly picks one 
of the two policies, with q being chosen with probability 
a, at the beginning of each period, fulfills the vector 
[aqn + (1 — ct)q'^. Further, since g„ and q'^ are both larger 
than for each n, aqn + (1 — oi)<l'n > for all n. Thus, the 
vector [aqn + (1 — a)q'n] also falls in the feasible region 
under P. A similar proof holds for the class of all policies. 

■ 

Note that if [g„] is feasible in P, then so is [q'n], where 

0<Q'n< In- 

Definition 5: [g„] is strictly feasible in P (or the class of 
all policies) if there exists some a e (0, 1) such that [q'^/a] 
is feasible in P (or the class of all policies).^ 

Definition 6: A scheduling policy 77 is feasibility optimal 
among P (or the class of all policies) if it fulfills every set 
of clients that is strictly feasible in P (or the class of all 
policies) . 

In the rest of the paper, unless otherwise specified, the 
default is the set of all policies. 

A The Static Channel Case 

In previous work [10], the problem of admission con- 
trol and feasibility optimal scheduling has been addressed 
for the case where the channel state is static, and all 
clients require the same delay bounds, i.e. |C| = 1 and 
Tn = T. In the special case, we will use p„ instead of pc,n 
since the channel state is static, and r instead of t„. 

Two largest debt first scheduling polices were proved 
to be feasibihty optimal, where the AP, based on the 
past history, calculates a debt for each client. In each 
period, the AP sorts all clients according to their debts, 
and schedules a packet for client n only after all packets 
for clients with larger debts have been delivered. The 
first policy, the largest time-based debt first policy, uses 
the time-based debt for client n at time slot t, defined 
as ^w„ minus the number of time slots that the AP has 
spent on transmitting packets for client n up to time slot 
t. The other policy, the largest weighted-delivery debt first 
policy, uses the weighted-delivery debt for client n at time 
slot t, defined as xin-^^nifl^ where dn{t) is the number of 
delivered packets for client n up to time slot t. 

As for admission control, the following lemma was 
proved in [10]: 

Lemma 3: A set of clients is fulfilled if and only if 
the long-term average number of time slots that the AP 
spends on transmitting packets for client n per period is 
at least ?«„ = ^ for each n. 

Further, since expired packets are dropped, the number 
of packets in the system is bounded. Thus, there may 
be some time slots where the AP may have delivered 
all packets in the system, and is therefore forced to stay 
idle. For any subset S of {1,2, ... ,N}, define Is to be 
the minimum number of time slots that the AP is idle 
in a period for any scheduling policy, given that the AP 
can only transmit packets for the subset S of clients. A 
necessary and sufficient condition for strict feasibility is 
proved: 

Theorem 1 : A set of clients is strictly feasible if and only 
if Enes Wn<T- E[Is], for all 5 C {1, 2 ... , N). 

^Equivalently, is an interior point of the feasible region under P 
(or the class of all pohcies). 



V. Time-Varying Channels 

We now discuss how to extend the aforementioned 
policies to provide QoS for time-varying channels. One 
intuitive approach is to decouple the channel states. The 
AP assigns a timely-throughput requirement gc.n for each 
channel state c and client n, with Ecec /c9c,n > In- Also, 
for each channel state c, the assigned throughput require- 
ments must be strictly feasible under that channel state, 
that is, Y.nes < T-E[I,,s] for all 5 C {1. 2, . . . , A^} , 
where Ic,s is the minimal number of time slots that the AP 
is forced to stay idle in a period under channel state c for 
any scheduling policy, given that the AP only transmits 
packets for the subset S of clients. More formally, we 
therefore seek a matrix Q = [qc,n\ that solves the following 
linear programming problem: 

Max J2n=l Ec&cfcQc,n 

Enes— <T- i?[/c,s], Vc, V5 C {1, 2, • ■ ■ , N}. 

Pc,n 

After obtaining the matrix Q, we can modify the two 
largest debt first policies to deal with time-varying chan- 
nel conditions. Let Sc{t) be the number of time slots up to 
time slot t that the channel state has been c, and assume 
that the channel state at time slot t is c. In the largest 
time-based debt first policy, we define the time-based debt 
for client n under channel state c as fEffiisin minus the 

T Pa,n 

number of time slots that the AP has spent on transmitting 
packets for client n under channel state c up to time 
slot t. In the largest weighted-delivery debt first policy, 
we define the weighted-delivery debt for client n under 
channel state c as t <ic,n-<ic,n{t) ^ w^here dc,n{t) is the 
number of delivered packets for client n under channel 
state c. Obviously, these two modified largest debt first 
policies are feasibility optimal. 

While this extension offers feasibility optimality the 
above linear program involves exponentially many con- 
straints. Further, it also requires the knowledge of the 
distribution [pcn] of channel states. In many scenarios, 
such as those with mobile nodes, this knowledge may not 
be available. This motivates us, in the following sections, 
to describe a more general class of feasibility optimality 
policies, and derive an on-line scheduling policy that is 
feasibility optimal for the time-varying channel condi- 
tions. 

VI. A Sufficient Condition for Feasibility 
Optimality 

We now describe a more general class of policies that 
is feasibility optimal. We start by extending the concept 
of "debt". 

Definition 7: A variable r„(A;), whose value is deter- 
mined by the past history of the client n up to the k^^ 
period, or time slot kT, is called a pseudo-debt if: 

1) r„(0) = 0, for all n. 

2) At the beginning of each period, r„ ( A:) increases by a 
constant strictly positive number Zn = Zn{qn), which 
is an increasing linear function of 

3) r„(fc + l) = r„(fc) + z„((jr„)-/i„(fc), where /i„(fc) is a 
non-negative and bounded random variable whose 
value is determined by the behavior of client n. 
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Further, /i„ (k) = if the AP does not transmit any 
packet for client n. 
4) The set of clients is fulfilled if and only if 

Prob{^^^i^ < £} ^ 1, as ^ 00, for all n and 
all e > 0. 

In the following example, we illustrate that both 
the time-based debt and the weighted-delivery debt are 
pseudo-debts under a static channel model. 

Example 1: At the beginning of each period, the time- 
based debt rn \k) increases hy w„ = and decreases 
by the number of time slots that the AP has transmitted 
packets for client n during the period. Lemma 3 shows 
that condition (4) is satisfied. 

Similarly, r„ (k), the weighted-delivery debt is also a 
special case. It increases by ^ at the beginning of each 

period, and decreases by — if a packet is delivered for 
client n during that period, and otherwise. It satisfies 
condition (4) by definition. □ 

We can also define the feasible region for debt in P (or 
in the set of all policies) as the set of [zn] such that 
the corresponding [g„] is feasible in P (or in the set of 
all policies). Since Zn is a linear function of qn and the 
feasible region for [qn] is a convex set (Lemma 2), the 
feasible region for [zn] is also a convex set. 

Using the concept of pseudo-debt, we prove a sufficient 
condition for feasibility optimality. The proof resembles 
one used by Neely [15], though in a different context, 
and is based on: 

Theorem 2 (Lyapunov Drift Theorem): Let L{t) be a 
non-negative Lyapunov function. Suppose there exists 
some constant B > and non-negative function f{t) 
adapted to the past history of the system such that: 

E{L(t +1) - L(t)|history up to time t} < B - ef{t), 

for all t, then: limsup,^^ i ^Lo E{f{i)} < B/e. □ 
Theorem 3: Let r„(A;) be a pseudo-debt. 

1) A policy that maximizes the payoff function 

N 

^ E{rn{k)+iin{k)\ck, Sk, [rmik)]} (1) 

n=l 

at the beginning of each period is feasibility opti- 
mal, where c^. denotes the channel state in the k*^ 
period, and Sk is the subset of clients whose packets 
arrive at the AP at the beginning of the A:*'* period. 

2) A priority-based policy that maximizes (1) over all 
policies in P is feasibility optimal in P. 

Proof: We present the proof for P only. A similar proof 
works for the class of all policies too. Define L{k) = 
5 E^=i rn{kf- Since r„{k + 1) = r^ik) + z^ - /U„(fc), 

A(L(fc)) := E{L{k + 1) - L{k)\[rm{k)]} 

N N 

=E{- J2 rnik + 1)' - 2 E rn{k f\[r^{k)]} 

n=l n—1 

N ^ N 

=E{J2rn{k)[zn - l^nik)] + - ^ [z„ - /x„ (fc)]^ | [r„ (/c)] } . 

n=l n=l 

Define B{k) := £;{jE,li[^n - Then 
B{k) < B, for all k, for some B. Hence for any policy in 



P: 

N 

A{L{k))<E{J2rn{k)[zn-^ln{kmrm{k)]} + B. (2) 

n=l 

Suppose [qn] is strictly feasible in P. The vector [z„] is 
thus an interior point of the feasible region (for debt) 
under P, and there therefore exists some a e (0, 1) such 
that [zn/a] is also in the feasible region under P. Let 
Zmin = mm{zi,Z2,-.-,ZN}- The AT^-dimensional vector 
[zmin] whose elements are all Zmin, falls in the feasible re- 
gion under P. Since the feasible region under P is a convex 
set, the vector a[zn/a] + (1 - a) [zmin] = [zn + (1 - Oi)zmin] 
is also in the feasible region under P. 

By Lemma 1, there exists a stationary randomized 
policy r]' in P that fulfills the set of clients with timely- 
throughput bounds for the vector [zn + (1 - oi)zmin]- Let 
n'nik) be the decrease in the pseudo-debt for client n 
under rj' during the period. Then, we have: 

EMk)[[rm{k)]} = E{E{t,^nik)\ck,Sk,{rm{k)]}} 

^ ~t~ (-^ 0^)Zn^^n• 

Above, the outer expectation in the RHS is taken over 
channel states and the vectors of packet arrivals. 

Let 77 be a policy that maximizes the payoff function 
(1), for all k, among all policies in P. Then defining /(i„(fc) 
and r„(fc) as the decrease resulting from policy t] and the 
pseudo-debt, we have: 

ELiE{rnik)+Hnik)[ck,Sk,[rmik)]} 

>j:LiE{rnik)+fj,'nmck,Sk,[rmm}- 

We can assume without loss of generality that the policy 
does not work on any client n with r„(A;) < 0, that is, 
lj,n{k) = if r„{k) < 0.^ From (2), we obtain: 

A(L(fc)) < E{j:^^,rn{k)+[zn - linikMrmik)]} + B 
< EiEn^Mkrizn - /xUfc)]|[r„(fc)]} + S 

Let e := (1 - a)zmin- By Theorem 2, 

limsupfe^^ i Eto E{Y.Li rn{k)+} < B/e. (3) 

Finally, since z„ is a constant and /i„(A:) is a bounded 
function, |r„(A; -|- 1) — r„(fc)| is bounded, which implies 

that I Y.n=i rn{k + 1)+ - E^Li is also bounded 

for all k. Thus, (3) implies that iE{J2^^^rnik)+} 
as — » cx), as shown in Lemma 4 oelow. This shows that 
''"^^^ converges to in probability for all n. Hence, r] is 
feasibility optimal in P. ■ 
Lemma 4: Let f{t) be a non-negative function such that 
\f{t + 1) - fit)[ < M, for some M > 0, for all t. If 
limsup,^^ i ELo /(«) < B/e, then lim*^^ \f{t) = 0. 

Proof: We prove by contradiction. Suppose 
limsupt^oo > for some ^ > 0. Thus, 

f{t) > tS infinitely often. Suppose f{t) > t6 for 
some t. Since [f{t) — f{t — 1)| < M, we have 
fit - 1) > t5 - M. Similarly f{t - 2) > td - 2M, 
f{t-3)>t6-3M,...J{t-[tS/M})>tS-[td/M\M>0. 

^ Since a policy cannot lose its feasibility optimality by doing more 
work, this assumption is not restrictive. 
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i=t-\tS/M\ 



Since f{t) > t5 



Summing over these terms gives: J2l= 

and thus, Eloi/«>^ 
infinitely often, linisupj_,go X^*^q = oo, which is a 

contradiction. ■ 
Theorem 3 suggests a more general procedure to de- 
sign feasibility optimal scheduling policies. To design a 
scheduling policy in a particular scenario, we need to 
choose an appropriate pseudo-debt and obtain a policy 
to maximize the payoff function. Maximizing the payoff 
function is, however, in general, difficult. Nevertheless, in 
some special cases, evaluating the payoff function gives 
us simple feasibility optimal policies, or, at least, some 
insights into designing a reasonable heuristic, as long 
as we choose the correct pseudo-debt. In the following 
sections, we demonstrate the utility of this approach. 

VII. Scheduling Policy with Rate Adaptation 

We now propose a feasibility optimal scheduling policy 
when rate adaptation is employed. Channel qualities can 
be time-varying and clients may have different deadlines. 

To derive the scheduling policy, we define the delivery 
debt rn \k) := <7„fc — (i„(fcr), where dn{t) is the number of 
delivered packets for client n up to time slot t. Thus, Zn ■= 
Qn, while /tin(A;) = 1 if a packet for client n is delivered in 
the period, and /x„(fc) = otherwise. 

Suppose at the beginning of period k, the delivery debt 

vector is [rl''^(fc)], the channel state is c, and the set of 
arrived packets is S. The transmission time for client n is 
Sc,n time slots, and client n stipulates a delay bound of 
Tn. Since transmissions are assumed to be error-free when 
rate adaptation is applied, the scheduling policy consists 
of finding an ordered subset S' — {mi,m2, . . . ,mN'} of 
S such that < n, for all 1 < / < tojv- That is, 

when clients are scheduled according to the ordering, no 
packets for clients in S' would miss their respective delay 
bounds. By Theorem 3, a policy using an ordered set S" 

that maximizes lines' ^n^^(^) with the above constraint 
is feasibility optimal. This is a variation of the knapsack 
problem. When S' is selected, reordering clients in S' in 
an earliest-deadline-first fashion also allows all packets 
to meet their respective delay bounds. Based on this 
observation, we derive the feasibility optimal scheduling 
algorithm, the Modified Knapsack Algorithm. Let M[n,t] 
be the maximum debt a policy can collect if only clients 1 
through n can be scheduled and all transmissions need to 
complete before time slot t. Thus, maxg' J2neS' i~n\k) = 
M[N,T]. Also, iteratively: 



> Algorithm 1 Modified Knapsack Policy 



M[n,t- 1] 
M[n,t] = { max{Af[n- 

■•l?\k)+M[n-l,t 



if t > T„ 



] } otherwise. 



where M[n— l,t] is the maximum debt can be collected 
when client n is not scheduled, and rn \k) + M[n — l,t — 
Sc,ri] is that when client n is scheduled. The complexity of 
this algorithm is 0{Nt), and it is thus reasonably efficient. 

VIII. Computationally Tractable Scheduling for 
Time-Varying Channels 

We now consider the case when rate adaptation is 
not available, and propose a scheduling policy for time- 
varying channels and homogeneous delay bounds. We 
show that the policy is feasibiUty optimal among all 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 

12: 
13: 
14: 
15 
16: 
17: 



for n = l X.O N do 

r^n\k) = qnk - dn{kT) 
Sort clients such that n < T2 < • • • < tat 
5" [0,0] = 4) 
Af[0,0] = 
for n = 1 to iV do 
for t = 1 to T do 
if i > T„ then 

M[n,t] = M[n,t- 1] 

else if client n has a packet AND 
rl^^ (fc) + M[n -l,t- Sc,n] > M[n - l,t] then 



M[n,t] 
S'[n,t] : 



: r, 

S' 



(3) 



(k) + M[n 

n — l.t — Sr 



else 

M[n,t] = M[n- l,t] 
S'[n,t] = S'[n-l,t] 
schedule according to S'[N,T] 



l,t- Sc 

] + W 



priority-based policies. We use the delivery debt, (fc), 
of Section VII. 

Suppose at the beginning of a period, the delivery 
debt vector is [rn\k)], the channel state is c, and the 
set of arrived packets is S. We wish to find the priority 
ordering that maximizes the payoff function fitot{k) = 
^^^j ri^'(fc)+ii^{/i„(fc)}, where in the expectation we 
suppose that the channel state c and the set of arrival 
packets S are both fixed. Obviously, transmitting a packet 
from a client n with r^f •* (k) < will not increase the value 
of Htot{k)- Thus, we do not give priorities to clients with 
non-positive delivery debts. For ease of the remaining 
discussion, we further assume ri^^ (fc) > for all n. 

Consider two orderings, A and B: In A, the priority 
order is {1, 2, . . . , iV}, while, in B, the priority order is 
{1, 2, . . . , m - 1, m + 1, m, m + 2, m + 3, . . . , N}. Let the 
values of the payoff functions be /u^^ and /i^^. Since 
clients 1 through m — 1 have the same priorities in 
both orderings and their priorities are higher than the 
remaining clients, the values of i?{/i„(fc)}, 1 < n < in — 1 
are the same for both orderings. On the other hand, 
clients m + 2 through N also have the same priorities 
in both orderings and they can be scheduled only after 
the packets for clients 1 through m + 1 are delivered. The 
probabilities of packet deliveries for these clients are the 
same under the two orderings. Thus, to compare the two 
orderings, one only needs to evaluate the probabilities of 
packet delivery for client m and m + 1. We further notice 
that the probabilities that packets for both clients m and 
m + 1 are delivered are also the same for both orderings. 
With e„ the event that the packet for client n is delivered, 

l^tot - l^fot =r^Hfc)ProHem\e„+i|ordering A} 

„(3) 



r)J,i{k)Proh{ern+i\ern\ordermg B}. 



Suppose that there are t' time slots left when all 
packets from client 1 through to — 1 have been delivered. 
The probabiUty distribution of r' is the same under both 
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orderings. Since the channel reliability is Pc,n, 

l^tot ~ M-tot 

=r^I\k)E{J2t^p,,m{l-Pc,my-\l-Pc,m+iy'-*} 

= [rm{k)pc,m - r-^+i(fc)Pc,m+l] 

X E{Y:t~oH^ -PcmYil- Pc,m+ir' 

Thus, > if rin\k)pc,m > r^+i(fc)pc,m+i. This 
leads us to obtain the Joint Debt-Channel PoUcy. The 
computation time is only 0{N log N). 

Algorithm 2 Joint Debt-Channel Policy 

1: for n = 1 to AT do 

2: r,?^ (fc) = qnk - dn{kT), for all n 

3: Sort clients with a packet arrival such that 

rf\k)Pc,i > r'i\k)p,a > ■■■ > r^„^(fc)Pc,JVo > 

> rj^] + l(fc)Pc.Aro + l > ••• 

4: Transmit packets for clients 1 through A^o by the 
ordering 



Theorem 4: The joint debt-channel policy is feasibility 
optimal among all priority-based policies. 

Proof: Let rj be the joint debt-channel policy and r]' 
any priority-based policy. Suppose the priorities assigned 
by the policies are ryi , 772 , . . . , r/™, and jji , r?2 , . • . , n'^, ■ We 
modify -q' as follows: 

1) Delete any element in ~ 77^, with r'^^} (k) < 0. 

2) For any client n with ri^-* (fc) > that is not in r][ ~ 
r]' ,, append it at the end of the ordering. 

3) If ri[ ~ 77^, is Still different from 771 ~ r/m, there ex- 
ists some n such that r^^} (k)pc „' < r^3^ {k)pc w • 

Swap r)'„ and 77;+!. 

4) Repeat Step 3 until the two orderings are the same. 
Steps 1 and 2 will not decrease the value of the payoff 

function. As derived above, Step 3 does not decrease the 
value of the payoff function, either. Thus, 77 maximizes 
the payoff function and is feasibility optimal in P. ■ 

IX. A Heuristic for Heterogeneous Delay Bounds 

We now describe a heuristic for packet scheduling, for 
the case where each channel state is static and trans- 
mission rate is fixed, but clients require different delay 
bounds. We use p„ to represent channel reliability. 

We will use the time-based debt, rn\k), as 
discussed in Example 1. The payoff function is 

EiEtiri'hkyfi^ik)}. 

Suppose, without loss of generality, that at the begin- 
ning of a period, packets for clients {1, 2, . . . , A^o} arrive. 
We further assume that ti < t2 < • • • < tn„ . Let 7„ 
be the number of transmissions the AP needs to make 
for client n for success. While 7„ is a random variable 
that cannot be foretold, we examine how to maximize 

J:nliri'\k)+Mk) if we knew 7„. 

We solve this by proceeding backwards in time. Dur- 
ing time slots [rNg^i + l.rjvo], all packets except the 
one for client No have expired, and we can only make 
transmissions for client A^o during these time slots. Thus, 



it does not make sense to schedule client A^o for more 
than 7]^°^ := J No — {tno — tno-i) transmissions before 
time slot tno-i- Next, in the time slots between [tn„-2 + 
1, tn„-i], only clients A^o — 1 and A^o can be scheduled. An 
obvious choice is to schedule the client with larger debt 
first, with the restriction that it is not scheduled for more 
than 7^"~^ time slots, and to then schedule the other 
client. (For simplicity, we let j^°zl ■= Tatq-i-) can 
further obtain the remaining transmissions allowed for 
client n before time slot tjvq_2, which we call 7,^"^^, as 
Jn°^^ minus the number of transmissions scheduled for 
client n during time slots [tjvo-2 + 1,tjvo-i]- Transmissions 
of the remaining time slots are scheduled similarly. 

While it is impossible to know the exact value of 7„ in 
advance, we can estimate it. One estimate is its expected 
value, However, this estimate does not consider the 

timely-throughput requirements. If a client has signifi- 
cantly larger debt than others, a reasonably good policy 
would allocate enough time slots so that the probability 
of packet delivery for the client in this period is at least 
its delivery ratio bound, ^ — ''"r(S) ' S^^^^ ^hat a packet 
for client n arrived. So we estimate 7„ by the number 
of transmissions that we need to allocate for client n so 
that it can achieve its delivery ratio bound. Since the 
channel reliability for client n is pn, this estimate 7„ is 
[log]^_p^(l - ^ — '',"^(5) )1 ■ thus derive the Adaptive- 
Allocation Policy shown in Algorithm 3. 

As a final remark, note that in all the three policies dis- 
cussed in this paper, we do not schedule transmissions for 
clients with non-positive debts. This restriction improves 
the performance for clients with non-real time traffic. In 
practice, it is possible that clients with real-time traffic 
and clients with non-real time traffic coexist. Thus, it is 
important not to allocate too much of the resource to real- 
time clients and starve those with non-real time traffic. 



Algorithm 3 Adaptive-Allocation Policy 

1: for n = 1 to Af do 

2: Tn (k) = time-based debt 

3: 7„ ^ [logi_pJl - ^-^^)] 

4: Sort clients so that packets for clients 1 ~ A'^o arrive 

and r[^\k) > ri^\k) > ■ ■ ■> r^](fc) 

5: alloc <— n X 1-vector 

6: for t = T to 1 do 

7: n ^ 1 

8: while (t„ > t or 7„ < 0) and n < A^o do 

9: n <— n + 1 

10: if ri^^ (fc) > then 

11: alloc[t] <— n 

12: else 

13: alloc[t] ^ A'^o + 1 

14: if n < A^o then 

15: 7n ^ 7n - 1 

16: for each time slot t do 

17: if alloc[t] < No and the packet for client alloc[t] has 

not been delivered then 
18: transmit the packet for client alloc[t] 
19: else 

20: transmit the packet with the largest positive time- 
based debt 
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TABLE I: MPEG Traffic Pattern 



Activity 


Great 


High 


Regular 


Data rate 


501S97 


392237 


366587 


Arrival probability 


1 


0.8 


0.75 



X. Simulation Results 

We have implemented the scheduling policies discussed 
in previous sections by using the IEEE 802.11 PCF stan- 
dard in the tis-2 simulator. We present the simulation 
results for the scenario with time-var3dng channels, and 
with clients requiring different delay bounds. In each 
scenario, we compare our policies against the two largest 
debt first policies of [10], and a policy that assigns 
priorities to clients randomly, random. IEEE 802. lie, an 
enhancement to 802.11 for QoS, allows clients with real- 
time traffic to use smaller contention window and inter 
frame space to obtain priorities over clients with non- 
real time traffic. However, clients with real-time traffic 
have to compete with each other in a random access 
manner with equal channel access probabilities, without 
any QoS based preference or discrimination. Further, the 
inter frame space and contention window size are smaller 
in PCF than in 802.11e. Thus, the random policy can be 
viewed as an improved version of 802.11e. Similar to the 
previous work, we conduct two sets of simulations for 
each scenario, one with clients carrjang VoIP traffic, and 
one with clients carrying video streaming traffic. The ma- 
jor difference between the two settings lies in their traffic 
patterns. Many VoIP codecs generate packets periodically. 
Thus, future packet arrivals can be easily predicted and 
may be dependent among different clients. For example, if 
two clients generate packets at the same rate, then either 
all or none of their packets arrive simultaneously. On the 
other hand, video streaming technology, such as MPEG, 
may generate traffic with variable-bit-rate (VBR). Thus, 
packets arrive at the AP probabilistically, with probability 
depending on the context of the current frame, and 
arrivals are independent among different clients. 

For the VoIP traffic, we follow the standards of the 
ITU-T G.729.1 [12] and G.711 [11] codecs. Both codecs 
generate traffic periodically. G.729.1 generates traffic with 
bit rates 8-32 kbits/s, while G.711 generates traffic at 
a higher rate of 64 kbits/s. We assume the period length, 
T, is 20 ms, and the payload size of a packet is 160 Bytes. 
The codecs generate one packet every several periods; 
with the duration between packet arrivals depending on 
the bit rate used. 

We use MPEG for the video streaming setting. MPEG 
VBR traffic is usually modeled as a Markov chain consist- 
ing of three activity states [13] [5]. Each state generates 
traffic probabiUstically at different mean rates, with the 
state being determined by the current frame of the video. 
The statistical mean rates in each state are those obtained 
in an experimental study [5]. We use them in setting the 
traffic patterns of MPEG traffic. We assume the period 
length to be 6 ms and the payload size of a packet to 
be 1500 Bytes. Table I shows the statistical results of the 
experimental study [5], where we also present them in 
terms of the packet arrival probability of our setting. In 
Table I, "Data rate" is measured in bits/GoP, where 1 
GoP= 240 ms. 

We simulate 20 runs for each setting, each run lasting 
one minute in simulated time. All results shown are 



averaged over the 20 runs. A natural performance metric 
for a client is the delivery debt, rn \k). The performance 
of the system is measured by the sum of the positive 
delivery debts of the clients, that is, J2n=i > the 
total delivery debt. In addition to evaluating how well the 
tested policies serve clients with real-time traffic, we also 
wish to know whether the policies starve those with non- 
real time traffic. Hence we add a client with saturated 
non-real time traffic in all simulations. Packets for the 
non-real time client are scheduled in all time slots that 
are left idle otherwise. We measure the throughput of the 
client with non-real time traffic by the average number of 
packets delivered. 

A Rate Adaptation 

We present the simulation results under the scenario 
where rate adaptation is applied, channels are time- 
varying, and clients may require different delay bounds. 

We first show the results for VoIP traffic. We use IEEE 
802.11b as the MAC protocol, which can provide a max- 
imum data rate of 11 Mb/s. We assume that the chan- 
nel capacity of each client alternates between 11 Mb/s 
and 5.5 Mb/s. Simulation results suggest that the times 
needed for a transmission, including all MAC overheads 
such as the time for waiting an ACK, are around 480 /xs 
and 610 /is for the two transmission rates, respectively. 
Ideally, the length of a time slot should be a common 
divisor of the transmission times needed under the two 
used data rates. We approximate this value by 160 us. 
Thus, transmitting a packet requires 3 time slots when 
using 11 Mb/s and 4 time slots when using 5.5 Mb/s. 
Further, a period consists of 125 time slots. 

There are two groups of clients, A and B. Clients in 
group A generate one packet every three periods, or 
at rate 21.3 kbits/s, and require 90% of each of the 
clients' packets to be delivered, or a timely-throughput 
requirement of 19.2 kbits/s. Clients in group B generate 
one packet every two periods at rate 32 kbits/s, and 
require 70% of each of the clients' packets to be deliv- 
ered, corresponding to a timely-throughput requirement 
of 22.4 kbits/s. The two groups can be further divided 
into subgroups, Ai, A2, A:^, Bi, and B2, each with 22 
clients. Clients in subgroup Ai generate packets at periods 
+ 3,i + 6, . . .], and clients in subgroup B^ generate 
packets at periods [i,i + 2,i + 4, . . .]. Finally, clients in 
group A require a delay bound equal to the period length, 
or 125 time slots, while clients in group B require a delay 
bound equal to two-third of the period length, or 83 time 
slots. 

Simulation results are shown in Figure 1. The modified 
knapsack policy incurs the least total delivery debt among 
all evaluated policies. This is because all the other three 
policies neglect the time-varying channels with different 
data rates and the heterogeneous delay bounds. Fur- 
ther, by only scheduling those clients with positive deliv- 
ery debts, the modified knapsack policy achieves higher 
throughput for the non-real time client than both the 
policies proposed in [10]. The random policy results in the 
highest throughput for the non-real time client. However, 
this is because it sacrifices the real-time clients. In fact, 
its total delivery debt is more than 300 times larger 
than the total delivery debt of the modified backpack 
policy. This huge difference suggests that the random 
policy, and therefore also 802. lie, are not adequate for 
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Fig. 1 : Performance for VoIP traffic with rate adaptation. 
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Fig. 2: Performance for MPEG traffic with rate adaptation. 



providing QoS when multiple clients with real-time traffic 
are present. 

Next we consider the scenario with MPEG traffic. Since 
video streaming requires much higher bandwidth than 
VoIP, we use 802.11a as the underlying MAC, which can 
support up to 54 Mb/s. We assume that channel capacity 
for each client alternates between 54 Mb/s and 24 Mb/s. 
The transmission times for a data-ACK handshake require 
660 us with 54 Mb/s data rate, and 940 iis with 24 Mb/s. 
The length of a time slot is 60 /US. Thus, the transmission 
times for the two data rates are 11 time slots and 16 time 
slots, respectively. Further, a period consists of 100 time 
slots. 

We again assume there are two groups of clients. Clients 
in group A generate packets according to Table I, and 
clients in group B are assumed to offer only lower quality 
video by generating packets only 80% as often as those in 
group A, in each of the three states. We assume clients in 
group A require 90% delivery ratios, and clients in group 
B require 60% delivery ratios. Since the length of a period 
for MPEG is very small, it is less meaningful to discuss 
heterogeneous delay bounds. Thus, we assume all clients 
require a delay bound equal to the length of a period. We 
further assume that there are 6 clients in both groups. 

Simulation results are shown in Figure 2. As in the case 
of VoIP traffic, the modified knapsack policy achieves the 
smallest total delivery debt among all the four policies. 
Also, by not scheduling clients with non-positive debts, 
the modified backpack policy also achieves the highest 
throughput for the non-real time client. 

B. Time-varying Channels 

We now consider the scenario with time-varying chan- 
nels, with all clients requiring delay bounds equal to 
period length. We model the wireless channel by the 
widely used Gilbert-Elliot model [4] [7] [19], with the 
wireless channel considered as a two-state Markov chain, 
with "good" state and "bad" states. A simulation study by 
Bhagwat et al [2] shows that the link reliability can be 
modeled as 100% when the channel is in the good state, 
and 20% when the channel is in the bad state. The du- 
ration that the channel stays in one state is exponentially 
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Fig. 3: Performance for VoIP traffic under time-varying 
channels. 



distributed with mean 1 - 10 sec for the good state, and 
50 - 500 msec for the bad state. 

While modifying the two largest debt first policies as 
suggested in Section V will yield feasibility optimality, 
such modification requires solving the linear program- 
ming problem and is intractable. Rather, we consider 
some easier modifications for the two policies. For the 
largest time-based debt first policy, we modify it so that 
it treats the channel as a static one, with link reliability 
equal to the time-averaged link reliability. For the largest 
weighted-delivery debt first policy, the weighted-delivery 
debt for client n at time slot t is defined as ^Qn — dn{t) 
divided by the current link reliability. 

For the case of VoIP traffic, we use 802.11b as the 
underlying MAC and use a fixed transmission rate of 11 
Mb/s. We consider the same two groups of clients as in 
the previous section. We assume that the mean duration 
of the bad state is 500 msec for all clients, and the mean 
duration of the good state is l + 0.5n sec for the n"' client 
in each subgroup. The time-average link reliability of the 
n*^ client in each subgroup can be computed as ^3^" . 
There are 19 clients in each of the subgroups. 

Simulations results are shown in Figure 3. The joint 
debt-channel policy incurs near zero total delivery debt, 
while all the other policies have much larger total de- 
livery debts. The fact that the largest time-based debt 
first policy fails to fulfill the set of clients suggests that 
only considering the average channel reliability, without 
taking channel dynamics into account, is not satisfactory. 
A somewhat surprising result is that the total delivery debt 
for the largest weighted-delivery debt first policy is even 
larger than that for the random policy. This is because the 
policy favors those clients with poor channels. When the 
channel state is time-varying, it may make more sense 
to postpone the transmissions for a client with a poor 
channel until its channel condition turns better. Thus, 
using weighted-delivery debt for time-varying channels is 
not only inaccurate, but even harmful in some settings. 
It can also be shown that the throughput for the client 
with saturated non-real time traffic is the highest with 
the joint debt-channel policy. By only scheduling those 
real-time clients with positive delivery debts, the policy 
prevents putting too much effort into any real-time client, 
and thus reserves enough resources for clients with non- 
realtime traffic. 

For MPEG traffic, we assume there are two groups 
of clients, with the same traffic patterns and delivery 
ratio requirements as those in the previous section. We 
use 802.11a with a fixed data rate of 54 Mb/s as the 
underlying MAC. The mean duration when the channel is 
in the bad state is 500 msec for all clients, and the mean 
duration in the good state is assumed to be 1 + 0.5n sec 
for the n*-^ client in each group. There are 4 clients in 
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Fig. 4: Performance for MPEG traffic under time-varying 
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Fig. 5: Performance for VoIP traffic under heterogeneous 
delay bounds 



both groups. 

Simulation results are shown in Figure 4. As in the case 
of VoIP traffic, the joint debt-channel policy incurs very 
small total delivery debt while all the other policies have 
significantly higher total delivery debts. This result sug- 
gests that the simple modifications of the two largest debt 
first policies do not work under time-varying channels. 
Also, by only scheduling real-time clients with positive 
delivery debts, the joint debt-channel policy achieves 
higher throughput for the client with non-real time traffic. 



C. Heterogeneous Delay Bounds 

Now, we study the scenario where the channel state is 
static but clients require different delay bounds. Since the 
length of a period for MPEG traffic is too small, we only 
simulate VoIP. There are two groups of clients. All clients 
generate traffic at rate 64 kbits/ sec, and thus each of them 
has a packet in each period. Clients in group A require 
90% delivery ratio, with delay bounds equal to the period 
length. Clients in group B require 50% delivery ratio, with 
delay bounds equal to two-thirds of the period length, or 
22 time slots. The channel reliability for the n*^ client in 
group A is (84 + n)%, and that for the n*'* client in group 
B is (29 + n)%. 

Simulation results are shown in Figure 5. The adaptive 
allocation policy has the smallest total delivery debt. This 
is because the other poUcies, especially the two largest 
debt first policies, do not consider heterogeneous delay 
bounds at all. It is not difficult to see that, to maximize 
the capacity of the system, a policy should, in some 
sense, work in an "earliest deadline first" fashion. Without 
considering heterogeneous delay bounds, the largest debt 
first policies may unwisely schedule clients with longer 
delay bounds before those with shorter delay bounds, and 
thus result in poor channel utilization. On the other hand, 
such poor channel utilization will result in a large number 
of idle time slots. Thus, the throughputs for the non-real 
time traffic under these policies are higher than those for 
the adaptive allocation policy. 



XI. Conclusion 

We have analytically studied the problem of scheduling 
real-time traffic over wireless channels. We have extended 
the model used in [10] to unreliable wireless channels 
and real-time application requirements, including traffic 
patterns, delay bounds, and timely-throughput bounds. 
We have developed a general class of polices that are 
feasibility optimal. This class can serve as a guideline 
for designing computationally tractable feasibility optimal 
policies. We have demonstrated the utiUty of the class 
by deriving scheduling policies for a general case when 
rate adaptation is employed and two special cases when 
it is not, time-varying channels and heterogeneous delay 
bounds. Simulation results show that the policies outper- 
form policies described in [10]. Thus we have shown not 
only that the policy class is useful in designing schedul- 
ing policies, but also that neglecting some reaUstic and 
complicated settings can result in unsatisfactory policies. 
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